-
Notifications
You must be signed in to change notification settings - Fork 577
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Configure OpenAI models in the app host #6577
Conversation
src/Components/Aspire.Azure.AI.OpenAI/DeploymentModelSettings.cs
Outdated
Show resolved
Hide resolved
src/Aspire.Hosting.Azure.CognitiveServices/AzureOpenAIConnectionResource.cs
Outdated
Show resolved
Hide resolved
src/Aspire.Hosting.Azure.CognitiveServices/PublicAPI.Shipped.txt
Outdated
Show resolved
Hide resolved
src/Aspire.Hosting.Azure.CognitiveServices/AzureOpenAIConnectionResource.cs
Outdated
Show resolved
Hide resolved
playground/OpenAIEndToEnd/OpenAIEndToEnd.WebStory/Components/Pages/Home.razor
Outdated
Show resolved
Hide resolved
src/Aspire.Hosting.Azure.CognitiveServices/IHasDeploymentsResource.cs
Outdated
Show resolved
Hide resolved
Overall looks great. @eerhardt's point about the breaking change is probably the main thing to consider. Besides that it looks pretty close to being ready. |
4587b4b
to
a29740a
Compare
14cec51
to
16a16a3
Compare
…ebros/hostmodels # Conflicts: # playground/OpenAIEndToEnd/OpenAIEndToEnd.WebStory/Program.cs # src/Components/Aspire.Azure.AI.OpenAI/AspireAzureOpenAIClientBuilderChatClientExtensions.cs # src/Components/Aspire.Azure.AI.OpenAI/PublicAPI.Unshipped.txt
I updated the PR. @SteveSandersonMS is this something we could merge in your PR as it's impacting how configuration is passed to the clients. Other option is I wait for your PR to be done and then react to the changes. |
@dotnet-policy-service - please keep this PR open. |
Use it in the OpenAI playground.
@sebastienros @captainsafia - I pushed some changes to this branch. I still need to update tests. But can you take a look at the current approach? |
src/Aspire.Hosting.Azure.CognitiveServices/AzureOpenAIExtensions.cs
Outdated
Show resolved
Hide resolved
- Obsolete the existing APIs - Add unit tests - Switch the deployment name to default to the resource name
Change CreateDeployment to not take a ref and return the same thing.
Note that since I created the PR, I can't approve it ✅ |
Configure OpenAI models in the app host as child resources. This allows for models/deployments to be WithReference'd directly and can easily be referenced from service apps. Contributes to dotnet#7907 * Add OpenAI child deployment resource. Use it in the OpenAI playground. * PR feedback - Obsolete the existing APIs - Add unit tests - Switch the deployment name to default to the resource name * PR feedback Change CreateDeployment to not take a ref and return the same thing. --------- Co-authored-by: Steve Sanderson <[email protected]> Co-authored-by: Eric Erhardt <[email protected]>
Building over @SteveSandersonMS PR to demonstrate the end-to-end experience when ai models/deployments are configured at the host level only.
Microsoft Reviewers: Open in CodeFlow